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Abstract 


This  ri'i)<)rt  (Icscribcs  rcsc'nrch  about  Jlow  yraph.H  -  lalu'h'd.  dinrti'd,  acyclic- 
Sraidis  which  abstract  rc'prc'sc’ii  tat  ions  usc'd  hi  a  variety  of  Artilicial  Intelli¬ 
gence*  applications.  Flow  grajihs  may  b<*  d<‘riv<*d  from  flow  yrnmmars  much 
as  strings  may  be  derived  from  string  grammars;  this  derivation  process 
forms  a  useful  model  for  the  stepwise  rc'finc'inc'nt  jirocc'sses  usc'd  in  jirogram- 
ining  and  othc'r  engineering  domains. 

The  central  rc'sult  of  this  rejmrt  is  a  parsing  algorithm  for  flow  graphs. 
Given  a  flow  grammar  and  a  How  greaph,  the  algorithm  dc'tc'rmines  whether 
the  grammar  gc'iieratc's  the  graph  and,  if  .so,  finds  all  possible  derivations  for 
it.  The  author  has  imjilemonted  the  algorithm  in  LISP. 

The  intent  of  this  rejiort  is  to  make  flow-gr.aph  peu-sing  available  as  an 
analytic  tool  for  rcjsoarchers  in  Artificial  Intelligence.  The  rc’port  explores 
the  intuitions  behind  the  parsing  algorithm,  contains  numerous,  extensive 
examjilcs  of  its  behavior,  and  provides  some  guidance  for  those  who  wish  to 
customize  the  algorithm  to  their  own  uses. 
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Chapter  1. 
Introduction 


Till  j  rcjiurf  siiiiiiiiarizos  research  about  flow  graphs,  a  graph-based  repre¬ 
sentation  abstracted  from  those  used  in  a  variety  of  Artificial  Intelligence 
applications.  A  flow  graph  is  a  laboh'd.  directed,  acyrhe  grajih  whose  nodes 
are  annotated  with  ports  — positions  at  which  edges  enter  or  leave  the  node. 
Hero  is  an  example  of  a  flow  graph: 


We  can  generate  complex  flow  graphs  from  sinijde  ones  by  replacing  .single 
nodes  with  niulii-nodc  subgraphs.  The  obvious  analogy  betwei'ii  this  process 
and  that  of  string  derivation  from  a  e ontext-free  graniniar  gives  ri.se  to  the 
notion  of  a  flaw  grammar:  a  set  of  rewriting  rules  which  .specify  how  to 
replace  given  nodes  with  p’r-specihed  subgraph.s.  Here  is  r.u  example  of  a 
rule  from  a  flow  granimor: 


}  hit rii*hn  t lajt 


Th<‘  fi-ntral  ri'sult  of  tlii^  report  is  a  parsing  algorithm  for  Row  graphs, 
(.oven  a  flow  graiimiar  and  a  flow  graph,  tlic  algorithm  detenmui's  wlirtlicr 
tli<'  grammar  gonoratc's  tla-  grapli  and,  if  so.  finds  all  jiossildo  derivations  for 
it.  The  algorithm  nms  in  time  polvnomial  m  the  iiuiuiht  of  innles  in  the 
input  graph,  with  an  exponent  and  constaiT  of  proportionality  defi'rmined 
by  the  input  granmiar.  The  author  has  implemented  the  algorithiii  in  LISP. 

1.1.  Motivation 

The  work  d<‘srribed  here  grew  out  of  the  author  ?  resoarrh  into  automated 
program  analysis  [Drotsky  1981j.  done  as  part  of  the  rrogramnier's  Appren¬ 
tice  proji-ct  at  the  Artificial  Intelligence  Laboratory  of  the  Massaclmsetts 
Instituto  of  Tix-hnoiogy  [Rich  and  Waters  1081  j  In  the  work  of  that  group, 
programs  are  represented  a.'  <innota'.ed  graphs,  called  plans,  whose  nodes 
stand  for  operations  and  whose  arcs  indicate  control  and  data  flow  between 
the  nodes.  (Plans  ere  additionally  annotated  with  a  great  deal  of  other 
information  about  the  program  they  .-epresent.  but  the  derails  of  these  an¬ 
notations  do  not  concern  us  here.  Interested  readers  should  consult  [Rich 
1980)  ) 

The  author's  idea  was  that  the  stepwise-refinement  process,  wherein  high- 
level  program  operations  axe  implemented  as  groups  of  lower-level  opera¬ 
tions.  could  nafur.ally  be  modeled  as  a  phiti-rcwritmg  process.  Thus,  flow 
grajihs  were  develo])od  as  all'll cartions  of  plan  structurr.  flow  grammars  were 
developed  to  encode  ;illowable  derivation  stops,  flow-graph  derivations  were 
developed  as  models  of  plan  derivations,  and  structural  program  analysis 
could  he  effrvted  tlirough  parsing. 

This  program-analysis  work  is  continuing,  but  doe.i  not  concern  us  here. 
Flow  graidis.  while  developed  as  ad  hoc  ahsrr.artions  of  phuis.  .are  gener.aJ 
enough  to  .serve  ns  abstractions  of  th<’  graphical  representations  of  other 
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domain.'  Till’  iiitciil  of  tlii.'  ri'iiorl  is  to  maki-  How  arai]h  parsing  availaldr 
as  ;ui  analytic  tool  for  AI  n  scan  lu  f'  ui  tlicsc  oiIht  <loinaiiis 


1.2.  Background 

Till'  stnictnrc  of  How  graphs  and  flow  grammars  h.as  hccn  inHiicnccd  liy  cajly 
work  on  treh  yrarnrmir,'  jrfalt/  and  Ro^cnfcld  10G9.  Montanan  1070:  Pavlidis 
1072;.  hnt  notic  of  this  work  wa^  concerned  with  parsing.  The  strurtnri'  of 
onr  imrsiii"  algorithm  .arose  from  r.areful  sMidy  of  Earley  s  algorithm  [Earley 
lOGO;  ami  Don.ald  E  Knnth  s  seminal  work  on  Ln(A.)  string  erammars  |19G3; 


1.3.  Structure  of  this  Report 

Ch.aptrr  1  of  this  report  is  this  iiitrodnrtiun.  Chapter  2  doserd'es  flow 
graphs,  flow  gramimar-.  and  fluw-gr.aph  derivation.'  m  detail.  Chapter  3 
pre.sent#  a  derivation  of  E.arh-y  s  algonthni  which  differs  considerably  from 
those  found  in  stand.ord  sources  This  derivations  is  given  as  background 
for  the  very  siiiular  derivation  of  the  giaphs  parsing  algorithm  presented 
in  chapter  4.  Finally,  chapter  5  discusses  How  gr.aphs.  grammars,  and  the 
parsing  algorithm.  This  discussion  includes  a  brief  complexity  analysis  of 
the  algorithm,  and  suggestions  for  related  research. 


Chapter  2. 
Definitions 


In  tliis  chapter  we  define  flow  graphs  and  flow  grammars,  and  give  the 
mechanism  by  which  a  grammar  derives  a  graph. 


2.1.  Flow  Graphs 


A  flow  graph  is  a  labeled,  acyclic,  directed  graph  whose  nodes  and  edges  are 

restricted  in  a  variety  of  ways: 

•  The  label  of  each  node  is  called  its  type. 

•  E.ach  node  has  a  set  of  input  porta  and  a  set  of  output  porta.  These  two 
sets  are  disjoint.  All  nodes  with  tJie  same  type  have  the  same  input  and 
output  port  sets. 

•  The  input  and  output  port  sets  of  flow  graph  nodes  are  never  empty. 
That  is,  all  nodes  have  at  least  one  input  and  one  output  port. 

•  Edges  in  flow  graphs  do  not  nm  merely  from  one  node  to  another,  but 
from  a  particular  output  po.  one  node  to  a  particular  input  port  of 
another.  No  two  edges  may  enter  or  exit  from  the  same  port,  so  a  node 
can  be  adjoined  by  only  as  many  edges  as  it  has  ports. 

Intuitively,  a  flow  graph  looks  like  this: 
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Notice  that  ports  (whirli  are  identified  by  numeric  annotations  on  the  nodes) 
need  not  have  edges  adjoining  them.  Any  input  (or  output)  port  in  a  flow 
graph  tliat  dues  not  have  an  edge  running  into  (or  out  of)  it  is  called  an 
input  (or  output)  of  that  graph. 

Notation 

We  will  always  direct  our  flow-graph  diagrams  from  left  to  right.  Wo  will 
often  subscript  node  types  so  as  to  make  them  into  unique  labels.  (This 
avoids  awkward  construction?  such  as  -the  third  a  from  the  botfom-left." ) 
When  we  do  not  care  whicli  nor  an  edge  adjoins,  or  if  this  is  niadv>  clear 
from  context,  we  will  onut  port  .mnotations.  If  we  omit  nil  the  ports  an¬ 
notations  on  a  node,  we  will  often  omit  the  circle  drawn  around  the  node's 
label.  Fiiiiilly,  we  will  always  emphasize  the  inputs  and  otitputs  of  graphs 
by  adjtiining  them  with  edge  stubs,  called  the  hading  anti  trailing  edges  of 
the  graph. 

Here  is  the  graph  we  saw  above  written  using  the  conventions  jtist  de¬ 
scribed: 
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We  will  use  this  form  whenever  possible. 

Terminology 

Tlic  linkage  in/ormation  for  a  node  in  a  graph  is  a  sot  of  (port,  edge)  pairs 
detailing  wliich  edge  adjoins  each  port  on  that  node.  For  example,  figure  2.1 
shows  a  graph  whose  edges  have  been  labeled  for  easy  reference.  The  linkage 
information  for  nudes  ai  and  zj  in  this  graph  is: 

oi  rj 

(l,ei>  (1,6#) 

(2,03)  {2.«7) 

{3.C4)  (3,e8) 

In  koi'ping  with  oiir  left-to-right  conventions,  that  portion  of  a  node's  linkage 
information  which  involves  only  input  (resp.  output)  edges  is  called  its  left- 
linkage  (resp.  right-linkage)  information. 


2.2.  Flow  Grammars 

Flow  grammars  are  a  generalization  of  context-free  string  grammars.  Essen¬ 
tially.  a  flow  grammar  is  a  set  of  rewriting  rules,  where  each  nile  explains 


rfi 
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Figure  2.1.  A  flow  graph.  The  edges  of  this  graph  have  been  labeled  for  easy 
reference. 


how  to  ropl='''e  a  node  in  a  graph  with  a  particular  sub-grapli.  Just  as  a 
string  graniii.aT  gradually  rewrites  a  single-clement  string  as  a  longer  and 
longer  string,  a  flow  graimuar  gradually  rewrites  a  single-node  graph  as  a 
larger  and  larger  graph. 

More  precisely,  a  /low  grammar  G  consists  of  4  parts;  a  set  P  of  produc¬ 
tions,  two  disjoint  sets  of  types  TV— the  non-terminals— axid  T— the  »ermi- 
nals,  and  a  distinguished  non-terminal  type  5— the  start  type  of  G.  Each 
production  in  P  consists  of  throe  parts:  two  flow  graphs  and  a  list  of  port 
correspondences.  The  first  of  the  two  flow  graphs — the  production’s  left- 
hand  side — consists  of  a  single  node  whose  type  must  be  from  N.  The 
second  of  the  flow  graphs— the  right-hand  side — consists  of  nodes  whose 
types  are  from  N  UT.  The  left  and  right-hand  sides  must  have  the  same 
number  of  inputs  and  outputs,  and  the  list  of  port  cone8j)ondcnces  is  a  1-1 
correspondence  between  inputs  and  outputs  of  the  two  sides. 

A  flow  grammar  is  shown  in  figure  2.2  Each  rule  maps  a  single  node  to 
a  graph.  The  left-hand  .«ido  no<l<'  of  each  rule  must  be  a  non-terminal,  that 
is.  of  a  non-terminal  type,  while  the  right-hand  side  graph  ran  mix  types  at 
will.  (We  will  indicate  non-terminal  types  with  capital  letters,  and  terminal 
types  with  lower  case  letters.) 

The  inputs  of  the  left-hand  .side  of  a  rule  correspond  one-to-one  with  the 
inputs  of  the  right-hand  side,  as  do  the  outputs.  Where  clarity  is  nc'eded, 
we  will  indicated  this  relationship  by  drawing  lines  betwwn  the  eilgc  stnbs 
adjoining  corresponding  ports,  as  was  done  above.  Where  it's  clear,  however, 
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we  will  iiiilicat*'  the  rtirrcspouclt-nci'  simply  hy  mirnirin^  tlic  aliniinn’iit  of 
Ic'fl-liaiul  siilc  ftl^r  stubs  with  lliost-  of  tin-  rishl-liaiKl  side.  Fur  I'xamplc. 
tli('  socuiiil  nih'  ill  the  ahuvi*  «raiiiiiiar  ruiihl  have  h's-ii  written  as  follows: 


3, 


a  •* 


Notice  that  there  is  no  flow-gramni.or  ctpiivalent  of  an  “e-nilc"  in  a  string 
grammar:  that  is.  there  are  no  flow  grammar  rules  whose  right-haml  sides 
are  empty.  This  is  because  it  is  m<‘aniiigless  to  rejilacc  a  node  in  a  graph 
with  nothing:  the  edges  that  were  adjoined  to  that  node  mus'  go  somewhere 

2.3.  Flow  Grammar  Derivations 

Flow  graphs  are  derived  from  flow  grammars  in  the  expected  way.  We 
start  with  a  graph  consisting  of  a  single  5-nodc  and  then  rewrite  it  with  an 
applicable  rule  from  the  grammar.  This  gives  us  a  flow  graph.  If  there  are 
no  non-terminals  in  the  derived  graph,  the  derivation  stops.  Otherwise,  we 
pick  a  non-terminal  and  a  rule  that  derives  it,  and  replace  the  non-terminal 
by  the  right-hand  side  of  the  nile.  This  gives  us  another  graph,  and  the 
whole  process  iterates. 

Of  course,  when  wo  replace  a  non-terminal  by  a  right-hand  side  that 
derives  it.  we  have  to  do  something  with  the  edges  that  adjoined  that  non¬ 
terminal.  This  is  what  the  port  correspondences  in  rules  arc  for:  if  p  was 
a  port  on  the  replaced  noii-terniiiial.  then  the  edge  that  adjoined  p  (if  any) 
is  made  to  adjoin  p  s  corresponding  port  in  the  replacement  gr.nph,  The 
restrictions  on  rule  formation  insure  that  there  is  never  any  question  as  to 
how  a  right-hand  side  should  replace  a  left-hand  side.  For  example,  figure  2.3 
shows  the  derivation  of  a  graph  from  the  grammar  given  in  the  last  section. 


Chapter  3. 

Motivation  for  the  Algorithm 


Earley’s  algoritlini  is  a  well-known  string  parsing  algurifliin  [Earley  1969], 
It  takes  a  string  grammar  and  a  string  as  inpnt,  and  di-terinines  .all  possible 
derivations  of  that  string  from  that  gnunin.ar.  The  output  of  the  idgorithm 
is  a  list  of  representations  known  as  items;  the  acceptability  and  derivations 
of  the  input  string  arc  encoded  in  this  list. 

This  section  presents  a  derivation  of  Earley's  algorithm  that  differs  sig¬ 
nificantly  from  those  found  in  standard  sources.  For  a  given  inptit  grammar 
and  string,  we  first  construct  a  non-detcrministic  stack-based  parser  for  the 
gr.'unrnar.  We  then  deterministically  simulate  the  behavior  of  that  parser 
when  run  on  the  input  string:  the  representations  of  the  parser's  config¬ 
urations  generated  ui  this  simulation  will  bo  homomorphic  to  the  items 
produced  by  Earley's  algorithm  when  run  on  the  same  input. 

The  derivation  given  here  is  presented  as  background  for  the  very  similar 
derivation  of  our  flow  graph  parsing  algorithm  given  in  the  next  chapter. 
Much  of  the  complexity  inherent  in  botli  algorithms  arises  from  optimiza¬ 
tions  that  arc  employed  in  the  simulation  process:  since  the  intuitions  under¬ 
lying  these  optimizations  ore  the  same  in  both  the  string  atid  graph  cases, 
we  bolii-ve  that  pri'scnting  them  in  the  relatively  familiar  context  of  .string 
parsing  will  nnake  their  use  in  grajdi  parsing  more  comprehensible. 


3.1.  Non-Deterministic  String  Pars' 

Given  a  context  free  gr.ammar  G  with  productions  Pi . and  start 

symbol  5,  the  following  constnictioii  yields  a  iion-dcterministir  stack-based 
parsi  r  for  G: 
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3  Afiitiv/ifioii  fur  fijc 


1.  (■oii.xfnu  t  ;i  nTu"iii7.»'r  for  tlir  ri^lit-liaiid  si(l('  of  cacli  P,. 

A  state  ill  tlic  rcroj'iiiy.iT  /?,  const  met  cil  for  rule  P,  will  dUisist  of  a  copy 
of  f',  s  ri;;lit-liaii(l  side  with  a  dot  placoi]  just  to  flic  left  or  ri^lit  of  one'  of 
its  syiiihols;  the  stalt'  sot  of  /?,  will  consist  of  all  tin'  states  formed  in  this 
way.  The  state  transition  function  of  /?,  will  map  (state,  syinhol)  ji.iirs 
to  states:  I'acli  state  with  a  dot  to  tlie  loft  of  some  symbol  s  will  have  a 
transition  on  s  to  the  state  whose  dot  is  just  to  the  ri"ht  of  .i.  The  initial 
state  of  7Z,  will  be  the  state  with  a  dot  to  the  left  of  the  leftmost  symbol 
in  P,'s  right-hand  side:  its  final  (arrepting)  state  will  be  the  state  whose 
dot  is  to  the  right  of  the  rightmost  symbol  in  P,'s  right-hand  side. 

For  example,  if  P,  is  the  production  A  — ►  xDAy.  then  the  recognizer  for 
P^  will  have  the  following  five  states: 

[A  — •  -xBAy] 

[A  -•  I  •  BAy\ 

[A  —  •  Ay] 

(A  -»  iBA-y) 

[A  -♦  xBAy-] 

and  the  transition  diagram  for  P,'s  recognizer  would  look  as  follows: 


InlllM  tUM  llnti  (Ul* 


2.  Create  a  state-based  machine  P  whose  state  space  and  transition  function 
is  the  union  of  all  those  of  the  recognizers  for  the  P,.  The  initial  and  final 
states  of  P  are  the  initial  and  final  states  of  the  recognizer  for  S. 

3.  Convert  P  to  a  non-deterministic  stack  machine  by  adding  a  stack  and 
instructions  as  follows:  For  each  state  s  which  has  a  transition  on  a  non¬ 
terminal  input,  associated  ins^nictions  to  that  state  which  (i)  push  the 
state  onto  the  stack  arid  (ii)  put  P  into  the  st.art  state  of  the  recognizer  for 
some  production  which  derives  that  non-terminal.  (If  the  non-terminal 
on  which  a  state  has  a  trajisition  has  n  possible  derivations,  then  this 
step  will  associate  n  iiistructinns  with  that  state.) 

4.  Complete  P  by  adding  iu.st  ructions  as  follow.s.  To  each  tircepting  state  of 
a  recognizer  for  a  P,.  add  an  instruction  which  (i)  pops  a  state  off  the  top 
of  the  stark  and  (ii)  put  P  into  the  state  which  is  led  to  by  the  popped 
state  s  tran.sition  on  the  non-terminal  derived  by  P,. 


3.1  Nuii-Dt'h'r.'jiini.^Hr  Striii;'  P.irstrs 


JD 

Tile  iiiacliiiic  P  Imilt  in  fliis  way  is  a  tnpMlown  UDiJ-di-tcniiiiiistic  parsar 
for  s('nt('iic<’s  (ltTiV(‘(l  from  fr.'  If  <ip('ral«-s  l>y  n-adiiif;  syiiilxils  (Uir  at  a 
film’  from  the  input  and  iiiakiii}?  appropriate-  sfalo  tran.'itiou.-  as  it  dot-s  so. 
Wlu’m’vor  it  I'liturs  a  state  whii’li  iias  .U'.soe  iatcil  stack  instructions,  it  chooses 
one  of  tliose  instructions  and  executes  if.  (Tlie  choice'  involved  Imre  is  what 
makes  the  parser  non-dete’rniinistic.)  We  lirst  consider  an  examjile  of  sucli 
a  parser,  and  then  discuss  some  iin|dications  of  tlio  ronsfniction  terlmiepie. 

3.1.1.  An  Example 

Consider  the  following  grammar  G: 


5  -  Aa 
A  -*  c 
A  -*  cA 


G  derives  all  strings  consisting  of  one  or  more  c’s  followed  by  an  a.  We  will 
carry  out  the  construction  described  above  so  as  to  produce  a  parser  for  G, 
and  then  run  this  parser  on  the  input  cca. 

First,  we  construct  state  machines  wliich  recognize  each  of  the  produc¬ 
tions  in  G.  These  arc  as  follows: 


'Actually,  this  machine,  is  merely  an  acceptor  for  such  sentences.  However,  if  we  have 
each  pii.'li  instruction  ui  P  output  the  nnii-tmninnl  which  gave  rise  to  the  push,  and  we 
output  each  input  syiiibul  as  it  is  re^ul.  iheu  e.ich  arrrptiiig  path  through  P  will  output 
a  Icftmo.st  derivntiun  for  the  sentence  accepted.  Thus,  we  view  P  aa  ^  parser. 


•'AV 


i  jV(»/i-D<’f(’ri;ii/jisfic  String  Piifsrrs 

S— »Aa 

A— -c 

A— cA 


Finally,  wc  complete’  the  construction  by  adding  stack  pops  on  reductions; 


iS  3  fur  the  Alfrorilliiii 

This  coiiipli't cs  nur  I'.irsci'.  WV  will  rcprfsriit  a  jjivcii  ciniti^uratidii  of  tlir 
j)ars('r  a.* 

(input  {xisitiun;  !(slaio):  ((stark  to])); . .  . ;  (stark  liottoiii))| 

wIkto  the  stat<’s  an-  rcprrsruird  using  tlir  dot  n’prrsoiitatioii  shown  above. 
(Rcrall  that  stack  entries  rire  just  states.)  For  example,  when  ninning  this 
parser  on  the  string  era.  it  .■<tart.<  in  the  following  conhgnration; 

0(0 

The  state  j5  — •  •  i4aj  has  two  transitions  on  push  instructions.  The  parser 
must  choose  one  of  the  two.  leading  it  into  one  of  these  two  configurations: 

0(()  • -c.  (5  — ►  •  Aa)] 

[A  cA,(S  ^  -Aa)) 

At  this  point,  no  more  state  transitions  are  possible  witho\it  reading  an 
input  symbol.  Thus,  the  parser  will  read  the  first  c,  leading  it  into  one  of 
these  configurations: 

1(c)  [A  c-.(5 -* -Aa)! 

[A  — ►  c- A,  (5  -*  •  Ao)] 

The  first  of  these  two  configurations  is  ai  accepting  state  for  the  rule  A  -♦  c, 
and  allows  a  pop  into  the  following  configuration: 

1(c)  (5-A-a,()] 

while  the  second  configuration  is  in  a  state  containing  push  transitions  to 
the  these  configurations: 

1(c)  [A  — »  •  c,  (A -►  c  ■  A,  S  — »  ■  Ao)) 

[A  — *  ■  cA,  ( A  — »  c  •  A;  5  — »  •  Ao)] 

Once  again,  no  more  state  transitions  arc  possible  without  reading  another 
input  symbol. 

We  ran  summarize  all  the  possible  computations  so  far  in  the  following 
tabular  fashion: 

0{t)  (5-A-a.()] 

(A  -*  •  c.  (5  -♦  •  Aa)] 

[A  —  ■  cA.  (S  — »  •  Ac)i 


3.1  l'ii>u-Drt('niiiitit‘tir  Striiif'  Parsers 
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l(r)  [j4  -*  c  j4«)j 

(.S’  —  01 

[A  c  ■  A.  (S  — »  •i4fl)j 
(i4  -*  ■  c.  (A  c  ■  A:  S  —t  ■  i4n)j 
'(j4  — •  -cA.  (A  —  c  ■  A:  S  —  •  .4a)] 

Wo  will  uso  this  fonn  oxtoiisivoly  to  sniniiiarizo  actions  of  those  jjarsers;  for 
example,  the  remauiJcr  of  the  nin  of  this  parser  on  tJio  string  cca  goes  as 
follows: 

2(cc)  (.4  -♦  0  •,  (/I  — ►  c  •  .4;  5  — *  ■  /la)] 

(A  — »  c/4  *,  (5  — *  •  Aa)\ 

\S^A-a,{]\ 

[A  -*  c-A,{A  -  c-/l:5  ^  -Ao)] 

[A  —  •  c,  {A  -*  c  •  A',  A  -*  c  •  A\  S  — *  •  Aa)] 

(A  — •  ‘  cA.  (A  — *  c  •  A,  A  — *  c  •  A;  5  •  Aa)] 

3(cca)  [5-*Aa-,()] 

3.1.2.  Discussion 

From  one  point  of  view,  this  construction  technique  produces  classic  recursive* 
descent  parsers,  such  as  those  prosent<>d  in  undergraduate  compiler  classes. 
Where  a  recursive-descent  parser  would  have  a  subroutine  dedicated  to  the 
recognition  of  each  rule's  right-hand  side,  these  parsers  have  state-machine 
recognizers,  and  these  recognizers  arc  linked  together  via  a  “subroutine- 
cair  mechanism  based  on  a  stack.  In  what  follow.s,  we  will  often  describe 
the  actions  of  these  parsers  using  terminology  suggested  by  this  metaphor. 

From  anotiier  point  of  view,  this  construction  technique  produces  clas¬ 
sic  push-down  automatata.  The  state-based  m.ichincs  constructed  for  each 
grammar  nile  are  finite-state  recognizers  for  the  right-hand  sides  of  those 
rules,  and  the  dots  in  their  states  indic.ate  the  expected  position  of  a  read 
head  in  the  par.scr's  input.  In  tliis  context,  the  stack  push  ;uid  pop  instruc¬ 
tions  act  as  t-transitions  between  the  various  recognizirs.  and  the  parser 
appear?  as  a  non-dctermiriistic  pusli-down  antoniafon  whose  finite  state  con¬ 
trol  conipar<‘s  siib.strings  of  the  input  against  the  right-hand  side  of  gram¬ 
mar  rules  and  wlio.se  stack  monitors  the  ceiiter-eiiiheddrdiiess  of  the  input 
as  a  whole.  In  what  follows,  w<'  will  also  use  teriniiiology  .-uggesteJ  by  this 
nietajihor. 
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3.2.  Simulating  the  State-based  Parser 

Ill  <»nl(“r  to  siiiinliitc  a  jiar.scr  ci.iistnu-tcd  as  above,  we  inii.st  jn-rforiii  all 
tli<-  aetioiis  wliicli  follow  from  all  possible  iioii-deteniiiiiistic  clioires.  The 
reeiirsive-di'.seeiit  iiiefaiilior  siii;};<'sts  that  w<-  do  this  with  a  se(]iieiitial  ap- 
proarh  that  employs  ba(krra<  king,  while  the  automaton  metaphor  suggests 
a  parallel  ajiproacli  in  whiili  one  simulator  state  repres<'iits  a  miiuher  of 
reachable  parser  states.  We  shall  adopt  this  latter  approach,  and  keep  track 
of  all  the  (state,  stack)  pairs  reachable  by  a  parser  at  each  step  of  the  in¬ 
put.  The  result  of  the  siiimlation  will  be  a  sequence  of  lists  of  reachable 
conliguratioms.  much  like  tho.se  used  in  the  sample  parse  above. 


<(■ 
c  ■ 


3.2.1.  Preliminaries 

We  use  here  a  slightly  different  representation  for  the  stack  segment  of  a 
configuration  than  we  did  in  the  sample  parse  above.  In  line  with  our 
subroutine-call  point  of  view  on  push  operations,  we  will  not  keep  the  whole 
stack  with  each  configuration.  Rather,  each  time  we  make  a  transition  to 
the  initial  state  of  a  recognizer,  we  will  ke<*p  a  return  pointer  which  indicates 
the  configuration  we  were  in  before  entering  that  state. 

For  example,  we  presented  above  the  configuration  sequence  for  the  parse 
of  cca.  If  we  make  the  representational  changes  just  described,  we  obtain 
the  following,  more  compact  representation,  in  which  we  have  subscripted 
the  configurations  for  use  in  retxu-n  pointers: 


0(t) 

(S  —  ".40.  ]i 

[i4  -»  -c,  1)2 
ji4  -►  -cA,  Ija 

;expand  A  from  item  1 

1(c) 

[A^c-,1U 

[5  -»  v4-o.  Is 
[A  c  •  A,  l]<j 
\A  -  -cGlr 
{A^-cA,Q]a 

;retum  to  item  1 

2(cc) 

\A  c  6)9 
[A  -*  cA  •,  l]io 

[5  -r  A’ a,  ]ji 
\A^c-A,Q]i2 
[>1  —  -c,  12]  j3 

km 


r— *- 

S*.‘ 


»-•  •-a  ^ m  * 


Pi. 2  Siiiiiilutijjff  the  P.vsi-r 
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•V 


1 


[A  -  tA.  121,4 

3(<'ca)  1*S’  — ►  An  •.  )  ;nrr<'])t 


'*’1 


a'-' 


We  cal!  flic  [(utafc),  {rcftini  ixiinfcr)]  |)iiir!i  used  Jicrc  items,  to  ilistiiigiii.'ili 
thciii  from  ronligiir.'ition  r<‘p  resent  at  ioiix  that  show  tlie  conijileto  stark.* 

3.2.2.  Multiple-Call  Collapsing 

It  is  convenient  to  think  of  this  method  as  simul.atiug.  not  one.  but  many 
noii-detorministic  parsers  at  the  same  time  As  these  parsers  run.  they 
make  different  decisions  at  each  choice  point,  and  the  simulation  kevp-s  track 
of  all  th<'  different  configurations  they  get  into.  At  any  po.sition  in  the 
input,  the  current  state  of  any  given  parser  is  contained  in  some  item  on  the 
current  item  list,  and  the  contents  of  that  parser  s  st.ack  may  be  computed 
by  following  return  pointers,  from  that  item  upwards. 

It  may  happen,  however,  that  two  parsers  whose  stacks  differ  enter  the 
same  state  at  the  same  position  in  the  input.  For  example,  consider  the 
following  grammar  C?': 

S  ^  S' 

S  —  S" 

S"  -» S' 

S'  -*Aa 
A  — ♦  c 
A  — ►  cA 

G'  derives  the  same  strings  as  the  grammar  G  given  above.  However,  if  G 
derives  a  string  via  derivtition  tree  T,  then  G'  derives  it  via  the  following 
two  trees: 


•1 


^Tbcir  rclatiousbip  with  Earley  item*  is  ncantised  beIo>». 
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3  for  fijc  AlfforitJuii 


Tree  1 : 


Tree  2 : 


The  pnr.illol  stnu-tnrp  of  these  trees  can  be  seen  rlenrly  in  the  following 
siinulatioii  of  a  parse  of  cca  under  G': 

0(0  [5 -.5',  h 

[S'  — *  •  Aa,  l|j 
[A --0,213 
(A  -  -cA,  2)4 

[5 -•5",  Is 
(5" 

[5'  -*  •  Aa,6]7  ;compare  with  item  2 

lA--c,7U 

(A  — »  -cA,  7)g 

1(0  [A-c-,2]io 

(5'  — *  A-a,  Ijii 
[A  — »  c- A.  2li2 
[A  -*  -0,12]  13 
(A  -  -cA,  12]i4 

[A  -♦  c-,7]i5  ;compare  items  15-19  with  items  10- 14 
(5'  — ♦  A-a,6)i8 
(A  -*  c-  A,  7]i? 
lA--c,17li, 

[A  -»  -cA,  17]i8 

2(cc)  [A— *c-,  12)20 

[A-cA-,2)j, 

[5'  -»  A-a.  1)22 
(A  -♦  c-  A,  12)23 


;compare  items  15-19  with  items  10  14 


3  2  Siinnliitiuf'  tlir  Stritr-hjun'fl  P/irncr 
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lA 

[^1 


T.  23)34 
•  cA.  23)25 


i-4  — •  r  17)25 
)/l  -*  r/1  •.  7)27 
(iV*  —*  A  ■  a.  0)28 
\A  -*  (.■•  w4.  17)2s 
[v4  —*  -c.  20)so 
[A  -  -0/1.29)31 


3(rpa)  ]vV'  —  Aa  1)33 
]5  -*  S'  ]i3 
)5'  -  /la -,6)34 

IS" -5' .,5)33  , 

(S-5"-,  )3« 

TJio  possible  ronfigiirations  obtained  upon  reading  earl)  of  the  input  tokens 
break  cleanly  into  two  groups  whose  state  transitions  are  identical  but  whose 
stack  etivironinent  is  different.  Each  group  can  be  thought  of  as  containing 
the  configurations  of  a  different  parser— one  predictijjg  the  derivation  that 
starts  S  -*  S'  and  the  other  pre<iicting  the  derivation  that  starts  5  -*  5"  — * 
S' .  The  similarity  between  the  two  groups  is  a  corollary  of  the  fact  that  our 
grammar  is  context-free.  In  both  cases  we  are  seeing  the  transitions  involved 
in  the  leftmost  derivation  of  cca  from  S'-,  these  transitions  must  remain  the 
same  regardless  of  the  context  of  S'  in  the  derivation. 

The  key  observation  here  is  that,  when  the  recognizer  for  a  given  rule 
is  called,  the  starting  position  of  that  recognizer  in  the  input  completely  de¬ 
termines  its  behavior.  A  particular  recognizor  may  be  called  from  parsers 
with  a  variety  of  stack  configurations,  but  if  all  the  calls  occur  at  the  same 
input  position,  we  need  only  simulate  the  .-itatc  transition.'  made  by  that 
recognizer  once:  the  results  can  then  be  used  in  all  the  parsers  that  made 
the  simultaneous  calls. 

With  our  representation,  this  optimization  i.s  easily  made  by  turning 
multiple  calls  to  the  same  recognizer  at  the  same  input  pi)sition  into  a  single 
call  with  multiple  returns  This  leads  to  the  following  parse  list  for  cca  under 
G'  (each  item  now  contains  a  set  of  retuni  pointers  instead  of  just  a  single 
one): 

0(0  (5--5'.{})i 


«1 


y.u 
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2(cc) 


3(cca) 


i‘^  {}l2 

IS"  S'.  {2}U 

|.S’'  -«  •.4a.  {1.3};4 
\A  —  ■(•.  {4}js 
j.4  —  l  A,  {4}io 

|A  ^r-.{4}l7 

1.V'  -  .4-a.{1.3}]8 
iA  -c-A.{4}jo 
lA  -*  -c.  {9})io 
(A  ■cA.{9)lii 

[A  -cA-.{4}1i3 
[S'  -  A-a.{l.3HH 
[A-r.A.{9}li3 
[A  —  -c.  {1,5}]i6 

lA-.-cA,{1.5}]n 

(5'-*Aa-,{L3}lig 

[5  — *  S'  •,  {}]jg 


;r(>iii]>;in-  willi  itniis  2  ain]  7  aluwc 


;rcturn  to  item  1,  accept 
;return  to  item  3,  . . . 

;  . . .  accept 


A  useful  way  to  conceptualize  tlic  optimiz.ation  performed  here  is  to  visualize 
the  parse  tree.<  “built"  by  the  pushes  and  pop.s  of  tljc  various  parsers  being 
siiimlatcd.  Before  the  optimization,  the  simulator  built  both  of  the  correct 
derivation  trees: 


3.2  Swtnlntmi'  the  StHtv-ltiiacd  Punter 
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After  the  optimization,  it  builds  the  following  hybrid  structure: 


The  latter  .structure  contains  the  same  information  about  tlje  par.^c  as  the 
two  previous  trees  together. 


>  i 


■4 


m 


•  - 1 
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3.2.3.  Left-recursion 


An  iinjiortaiit  snh-fust-  in  wliicli  iiinltiplc-<;ili  (•()llaj)si]i;4  is  .ipplicabh'  is  that 
(if  h'ft-rcciirsivc  j'raniiiiar  riilcs.  Tlicst'  rules  pres'-nt  w('ll-kni)wn  ditticnlties 
fur  (letermiiiistic  reeursivi'-desrent  parsers.  l)('e;«ise  tlie  p.arser  can  net  know 
Iiovv  many  tinu's  to  inv<)k('  tin*  recursive  exp.ansion  of.i  non-terminal  without 
looking  aln'.'ul  in  the  input.  For  ex.ainple.  con.sider  tin'  following  grammar: 

S  — •  Aa 
A  c 
A  ^Ar 


This  granular  derives  exactly  tlie  same  strings  as  the  riglit-rerursivo  gram¬ 
mar  G  given  above,  but  eonsider  the  following  "parse"  of  the  input  string 
ecu  (we  liave  not  used  multijde-call  collapsing): 


0(0  [S-*.Aa.,\i 

[A-^-cA]i 
\A  —>  -  Ac.  Ijj 
[A-.c,3|4 
[A  — •  •  Ac,  3)5 
{A  -*  -0,5)6 
\A  -*  •  .(4c,  5)7 
{A-*-eJ]i 


;expand  A  from  item  1 
;<litto 

;expand  A  from  item  3  (uh  oh) 
;and  so  on 
;and  so  on  . . . 


1(c)  [A c l|oo-(-l 
(5  —  i4-a,  ]oo^2 
[A  -»  c-,3]oo.,.3 
\A  ^  a  '  C,  l]no  +  4 
(a  — ♦  c  5]qo.,  5 
[i4  A  '  C.  3jao.r6 
[A  c 8|qq+7 

\A  v4  -CjSloo-i-s 


;return  to  item  1 
;retum  to  item  3 
;rctvini  to  item  5  (uh  oh) 
;arid  so  on  . . . 


2(cc)  [(4  — •  v4c l]oo  t-oo-i-i 

(.9  A -a.  ]oo-K»e+2 

\A  Ac  3|QQ..-Qo.f  3 

\A  — *  /4  •  c.  l]oo+(»  (-4 


>'1.2  Siitiulntwff  thr  Stntc-lnisvil  Parurr 


27 


[A  — •  At.  \  5jao  •  00  •  3 
[A  *  ^4  •  f.  3]<x  ■  oo '  0 


3(f’ra)  (iV  — •  An  \  ] 


If  wp  perform  multipl<‘-<-.ilI  collapsing,  however,  soim-thing  very  interesting 


happens: 

0(c) 

[S  -  -  An,  Oil 
(A  —  c.  {1.3}]2 
(A  -  •Ac.{1,3}|3 

;cxpand  item  from  items  1  and  3 
:notc  the  ae//-recursion  here 

1(c) 

[A-c-,{1,3}]4 
[5  A  -  a.  {}js 
[A  -  A-c,{l,3]la 

;rotum  to  item  1  . . . 

;  and  again  to  item  l! 

2(cc) 

(A  -*  Ac-,{1,3})7 
[5  A-a,{}jg 
[A- A-c,{I.3})o 

3(cca) 

[5  —  Aa  •,  {}]io 

The  subtlety  here  involves  item  3,  which  serves  the  same  purpose  as  items  3, 
5.  7.  9.  . . . ,  in  the  previous  simulation.  We  are  in  fact  simulating  an  infinite 
number  of  parsers  here,  one  predicting  each  of  the  following  parse  trees: 


6  S  e  Cl 


At  any  given  point  past  the  fir.st  c  in  the  input,  however,  they  have  all  invoked 
the  same  recognizer  (for  A  — *  Aa)  at  the  same  point,  so  the  simulation  keeps 
just  one  representation  for  all  of  them. 


3.2.4.  Duplicate-Item  Merging 

Multiple-call  collapsing  optimizes  the  case  where  different  parser.^  invoke 
the  same  recognizer  at  the  same  point  in  the  input.  If  we  consider  only 
unambiguous  grammar,  thi.^  is  the  only  case  in  which  recognizers  invoked  by 
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tlilfwiit  j)ars(TS  an’  '»n<iranf<’<‘(l  to  ix'rfonii  iili'iitical  .'u  tioiis.  Diit  nuisitlcr 
the  following  aiiilii^uuii^  j^rainiiiar  fraj'im’iit ; 

.V  —  A... 

A  ^  BC 

D 

D~*bb 
C  -^bc 
C-^c 

Tins  fragment  produce?  tlic  following  two  derivations  of  flic  string  fragment 
bbc: 


Those  derivations  are  recovered  in  the  following  parse: 

0(€)  \A-^-DCA}]i 

[5--6,{l}]j 

1(6)  (S-6-,{l}l4 

\A  B’C,  {}]5 
[C’--6c,{5})6 
[C--c,{5}l7 
[B  -»  6-6,  {!}]$ 

2(66)  lC-6-c.{5}lo 

[A  — •  B  •  C.  {})ii  ;comp«'irc  with  item  5 

[C--6c.{n})n 

3(66r)  [C -6c-.{5}]i4 

(A  -»  BC  ••  {}Ii5 

[C  -*  C-, {ll})io 


/.N. 

■ 

»  -V 


[• 


V'  *1 


w  - 


VV^ 
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[i4  — *  ' {})i7  with  item  15 

Nt)t<’  that  itciu.'i  15  iiiid  17  art'  itlcjifiral.  TIk-  situation  cik oniitiTC*!  lnT<' 
is  (jnitf  similar  to  that  in  which  w»'  invoke  nmltij)le-fall  collapsing,  in  that 
recognizers  for  tin-  .saiiu'  nile  itivoked  sinmltaneonsly  hy  (liH‘<‘rcnt  parsers 
hiive  nviched  the  same  state  at  tin*  same  point  in  tin-  ininit.  In  this  ease  that 
state  is  not  tlie  rerognizers'  initial  state,  but  the  same  rea,soning  shows  that 
bofli  recognizers  will  perform  identical  actions  until  tlieir  re.ipective  parsers 
make  differing  derivation  decisions.  Tims,  .as  with  innltiple-rall  collapsing, 
we  need  only  kei'p  one  item  to  represent  the  state  of  both  recognizers. 

3.2.5.  The  String  Algorithm 

We  are  now  ready  to  state  onr  string  p.irsing  algorithm.  The  algorithm 
takes  as  input  a  grainni.ir  G'and  a  string  a.  and  determines  whether  G 
generates  s.  The  output  of  the  algorithm  is  a  sequence  of  item  lists— one 
for  each  symbol  in  a — whicli  represent  all  the  eonhgurations  re.achable  by  a 
non-dcterniinistic  string  parser  for  G  operating  on  s,  The  algorithm  does 
not  con.struct  a  parse  tree  for  the  input,  but  we  show  below  how  it  can  easily 
be  modified  to  construct  all  possible  ones. 

The  algorithm  operates  by  using  a  list  of  items  /,  to  keep  track  of  all 
the  configurations  a  parser  might  bo  in  after  reading  the  i-tli  input  symbol. 
Given  lists  /q,  .  .,  /i-i,  the  algorithm  constructs  list  I,  by  using  three 
operations:^  a  scanner  operation,  a  predictor  operation,  and  a  completer 
operation.  We  first  describe  the  nature  of  these  operations,  and  then  how 
the  algorithm  uses  them  to  construct  the  lists  lo,  h,  ■■■ ,  In- 

The  Scanner 

The  scanner  operation  takes  as  input  an  item  i  from  list  and  the  j-th 
input  .symbol  Oj.  Let  .s  be  the  .state  part  of :  and  r  it.s  .set  of  return  pointers. 
If  3  has  no  transition  on  Oj.  tlicn  the  seannor  does  nothing.  Otlierwise.  a 
has  a  transition  on  Oj  to  some  state  s',  and  the  sc.anncr  creates  an  item  t' 
on  list  Ij  who.se  state  part  is  .s'  .and  who.sv  list  of  return  pointers  is  r. 

Wc  c.an  abbreviate  the  scanner  operation  as  follows:  Let  [A  — •  a'tfJ.r] 
be  an  item  from  /j-j.  If  f  is  the  j-th  symbol  of  the  input  string,  then  the 
sc.anncr  adds  the  item  [/4  — *  a<  •  0,  r]  to  Jj. 

■^Tlie  niunes  of  these  operations  are  t.aken  from  jEaxley  1960). 
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The  Predictor 

Tlu'  prcdiclcir  ojKT.’itioii  takes  as  input  an  item  t  frtnn  list  If  tlie  state 
piirt  s  of  i  does  not  have  a  transition  on  a  non- lenniiial  node,  tlien  tlie 
j)r<'(lict<)r  ojteration  do<'s  notliinj.e  ()tlierwis<'.  let  ,4  In-  the  non-terminal  on 

whifli  .s  has  a  transition,  and  let  .S|,  ,S2 . -Sr,,  lu'  tin’  initial  states  of  all  the 

n*eo>;nizors  for  rules  whkh  derive  A.  For  each  .s, .  the  predictor  operation 
check#  to  see  if  there  is  an  item  with  state  p;irt  on  list  /j.  If  so.  the 
predictor  adds  t  to  the  retuni  set  of  that  item.  If  not.  the  predictor  creates 
an  item  with  state  part  .s,  and  return  set  {t}  and  adds  it  to  1^. 

Wc  can  ahhreviate  the  jiredictor  operation  as  follows;  Let  !/l  — *  o  • 
be  an  iti'm  on  Ij.  For  tdl  rules  B  —  /}  iu  C.  the  predictor  ojieration  searches 
Ij  for  an  item  of  the  form  [5  —  ■  (3.r\.  If  it  finds  one.  it  adils  t  to  r. 
Otherwise,  it  adds  an  item  [B  ■  0,  {t}j  to  Ij. 

The  Completer 

The  completer  operation  takes  as  input  an  item  t  on  list  ly  If  the  state 
part  of  i  is  not  the  accepting  state  of  a  recognizer  for  some  rule  of  G.  the 
completer  operation  does  nothing.  Otherwise,  let  A  be  the  non-tcrminal 

derived  by  the  accepted  rule,  and  let  :i . be  the  members  of  the 

return  set  of  t.  The  state  part  of  each  »,  must  have  a  transition  on  A\  let  sj, 
. .  . ,  Sm  be  the  state.s  led  to  by  those  transitions.  For  each  t,.  the  completer 
looks  for  an  item  on  Ij  whose  state  part  is  a,  and  whose  return  set  is  that 
of  i,.  If  it  finds  one,  it  does  nothing,  otherwise  it  adds  such  an  item  to  ly 

The  completer  operation  may  be  abbreviated  as  follows:  Let  [/i  ^  ,ril 

be  an  item  in  Ij.  For  each  item  \B  —•  o*i4/3,  r2],  such  tha*l  i  €  rj,  add 
[B  — *  ai4  •  0,  rj]  to  Ij  if  it  is  not  already  there. 


The  Algorithm 

First,  we  construct  la  as  follows; 

1.  Let  ai,  ....  be  the  initial  states  of  recognizers  for  the  rules  in  G 
which  derive  5.  For  each  a,,  add  an  item  to  1^  whose  state  is  a,  and 
wliosc  return  set  is  empty. 

2.  Complete  /o  by  niniiing  the  predictor  on  every  item  in  it.  If  new  items 
arc  added  to  it,  run  the  predictor  on  them,  and  repeat  this  until  no  new 
items  iirc  added. 
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NfXt.  w<'  .■iU('<-{‘s.'<iv/  ly  construct  /j . (livi'ii  Jo . Ij  j.  we  ron^triict 

Ij  rtj(  follows: 

3.  Run  the  scfiniier  ovct  <'very  item  in  /j.  i. 

4.  Run  the  coinph'fer  ()V<t  every  itiun  in  [j.  If  this  adds  new  items  to  ly  run 
the  ronipletcr  over  then:.  ;uid  repeat  this  until  no  new  items  are  added. 

5.  Run  the  predictor  over  every  item  in  7^.  If  this  a<hl.'  new  items  to  7, .  mu 
the  predictor  over  them,  and  rei)eat  this  until  no  new  items  are  added. 

A  little  thou(:ht  will  ronvinr*'  the  reader  that  this  is  indeed  tlie  algorithm 
used  to  produce  t’le  lists  shown  above.  A  string  is  accepted  hy  this  algorithm 
if  In  contains  an  item  whose  return  set  i.s  empty  and  whose  state  part  is  the 
accepting  state  of  a  recognizer  for  a  nile  deriving  S. 

3.2.6.  Why  is  this  Earley’s  Algorithm 

The  algorithm  described  above  docs  not  appear,  prxma  facia,  to  be  Earley’s 
algorithm.  The  apparent  difference  is  due  to  a  couple  of  factors,  both  of 
which  we  examine  here. 

Abbreviation  of  Return  Pointers 

Our  algorithm  uses  items  of  the  form  |A  — *  where  r  is  a  set  of 

return  pointers.  Earley’s  itcm.s  have  the  form  [A  —>  a-  p.  i).  where  7,  is  the 
number  of  input  symbols  read  when  the  A  recognizer  was  first  invoked.  (Of 
course,  at  that  time,  the  recognizer  was  represented  by  an  item  of  the  form 
\A  -»  •a/3,»].) 

These  repre.'e:it.ation«  seem  unrelated;  however,  some  thought  reveals 
that  wc  can  encode  our  represeiit.ation  in  E.ariry’s  form.  An  item  of  the 
form  [A  — *  -a-rj.  when  added  to  li.st  7,.  represents  a  call  on  one  of  A’s 
recognizer.*  at  point  t  in  the  input.  Thus,  the  callers  of  such  an  itcm--tlic 
rnonibers  of  r  -inust  he  all  the  items  for  recognizers  which  expect  to  see  an 
A  at  point  t  in  the  injiut.  But  these  items  are  exactly  all  those  on  7,  which 
liave  an  .4  to  the  right  of  their  dot.  Thus,  if  .in  item  of  the  form  [.4  — ►  •  Q,r| 
appears  on  I,,  r  inu.*t  consist  of  exactly  those  itt-nis  on  7,  that  have  an  A  to 
the  right  of  their  dot.  so  we  ran  encode  r  with  the  integer  i. 
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Handling  of  (-rules 

Earlry'^  al;;(irithiii  liaiidlcs  ^raniinars  with  productions  of  tlu'  form  ^4  — *  (.^ 
This  involves  r.uiniti^  tlie  coinpleter  on  Jo.  and  altt'mating  tin-  repeated 
application  of  steps  4  and  3  (instead  of  ai^plying  one  n'peatedly  and  then 
the  other). 

If  tliese  stej)s  were  added  to  otir  algoritliin.  and  if  the  representation  were 
changed  as  mentioned  above,  otir  algorithm  description  would  agree  exactly 
with  the  do.scription  given  by  Earley  in  [Aho  and  Ullniaji  1972]. 

3.2.7.  Using  the  Algorithm  to  produce  Parse  Trees 

The  algorithm  wc  have  presented  here  is  actually  an  acceptor,  not  a  parser. 
Th.at  is.  while  its  outptit  mdicates  immediately  whetlier  or  not  the  input 
string  is  in  the  language  of  the  input  grammar,  it  does  not  provide  a  parse 
tree. 

Algorithms  are  available  from  a  variety  of  sources  (e.g..  [.\ho  and  Ull- 
man  1972])  which  produce  a  parse  tree  from  the  parse  lists  output  by  our 
algorithm.  In  addition,  consider  the  following  definitions  of  the  scanner  and 
completer  operations; 

The  Completer 

The  completer  operation  takes  as  input  an  item  i  on  list  Ij.  If  the  state 
part  of  f  is  not  the  accepting  state  of  a  recognizer  for  some  rule  of  G.  the 
completer  operation  does  nothing.  Otherwise,  let  A  be  the  non-terminal 
derived  by  the  accepted  rule,  and  let  tj,  ...,  im  be  the  members  of  the 
return  set  of  i.  The  state  part  of  each  i,  must  have  a  transition  on  A\  let  sj, 
....  Sm  be  the  states  led  to  by  those  transitions.  For  each  i,.  the  predictor 
looks  for  an  item  on  whose  state  part  is  s,  and  whose  return  set  is  that  of 
t,.  K  it  finds  one.  it  add.s  to  it  a  pointer  to  i  and  a  pointer  to  /,.  otherwise 
it  adds  such  an  item  (including  these  pointers)  to  Ij. 

The  Scanner 

The  scanner  operation  takes  as  input  an  item  t  from  list  and  the  j'-th 
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input  syinlxil  iij.  Lrt  .•<  lu'  llic  state-  part  of  i  and  r  its  sot  of  n-tiirii  i)ointors. 
If  s  liiis  no  transition  on  t.  tlion  tin-  scaniuT  diu-s  notliiii}'.  Otlu-rwise-.  s 
lias  a  transition  on  t  to  soim-  stato  s',  and  tin-  scaniior  croat os  an  item  i'  on 
list  /j  whoso  state-  jiart  is  s',  whoso  list  of  n-turn  jioinlors  is  r,  and  which 
contains  tho  saino  coniploti-r-addotl  jiointors  as  i  (if  any). 

K  the-  al};orithin  ns<-s  tin  si-  di-Hnitions.  oaoh  itoin  of  tin-  form  \A  —•  a-,rj 
in  the  constnictod  lists  will  he  the-  root  of  a  pointer  stnirtnro  ijiving  all 
the  derivation  tree?  for  that  instance  of  .4  in  the  input,  Li  [larticnlar.  if  a 
sentence  is  accepted  by  the  algorithm,  the  items  of  the  form  [5  — * 
on  In  will  bo  the  roots  of  all  the  derivation  trees  for  that  sentence. 


Chapter  4. 

The  Algorithm 


III  tlii.^  chapter  wc  prc.xont  our  flow  gr.iph  parsing  algorithm.  The  inputs  to 
the  algoritliiu  arc  a  flow  grammar  and  flow  graph;  its  output  is  a  sequence 
of  lists  similar  to  the  item  lists  produced  by  Earley's  algorithm. 

As  in  the  last  chapter,  we  will  produce  the  algorithm  by  developing  a 
non-determini.stic  parser  and  then  simulating  its  behavior  deterministically. 
Doth  the  par.xer  and  the  simulation  technique  generalize  those  we  used  for 
strings:  the  resulting  algorithm  is  a  generalization  in  that,  when  it  is  nm  on 
a  string  graph,  it  performs  a  superset  of  the  actions  performed  by  our  string 
algorithm. 


4.1.  Non-Deterministic  Graph  Parsers 

The  method  wo  used  to  construct  a  parser  for  a  string  grammar  consisted 
essentially  of  two  steps: 

1.  Construct  recognizers  for  the  right-hand  sides  of  each  of  the  grammar’s 
productions. 

2.  Construct  a  stack-based  machine  out  of  these  rcrognizcr.s  by  replacing 
their  non-terminal  recognition  steps  with  "subroutine  calls"  on  other  rec¬ 
ognizors. 

We  will  apjdy  tliis  same  method  to  flow  grammars  in  order  to  construct 
flow  graph  parsers.  The  nature  of  this  constnicticm  is  determined  by  our 
gruernlizations  of  (i)  the  mechanism  used  to  read  the  parser's  input,  (ii) 
tlie  recognizers  used  for  the  riglit-haml  sides  of  grnininar  ndes.  and  (iii)  the 
liukiige  HKTliauisin  used  to  interconnect  recognizers.  Each  of  these  general- 
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i/.atioiis  j)n’S(TV<'s  iiitnitions  tliat  aris*'  in  tin*  striiii'  case.  Imt  pliras('s  tlicso 
iiituitii)iis  s(i  as  to  make  tlieiii  aiiplieahle  td  grajilis  as  well  ;us  slriii);s. 

4.1.1.  Reading  a  Flow  Graph 

Oitr  string  p.ars(’r  ronstmeted  a  piirse  for  its  input  wliilo  reading  it  onee  from 
left  to  right,  and  so  will  our  grajili  parser.  ’Once'  nica;i.s  that  the  parser  will 
look  at  each  node  in  the  input  only  one  time.  ‘From  left  to  right'  means 
that  the  parser  will  consider  nodes  in  the  p.arti.al  order  imposed  by  the  input 
graph;  that  is.  a  node  in  the  injuit  will  he  looked  at  by  th<’  p.irser  only  when 
it  ha.s  already  looked  at  .dl  that  ntule's  predecessors. 

As  mentioned  in  the  last  chapter,  it  i.s  natural  to  think  of  our  string 
parser  .as  an  .automaton  using  a  read  hea<l  to  examine  its  input.  This  head 
moves  from  left  to  right  over  the  input,  passing  the  symbols  read  on  to  the 
state-transition  functions  of  the  parser's  active  recognizers. 

Our  graph  parsers  will  examine  their  input  graphs  as  if  they,  too,  had 
read  heads.  These  heads  should  be  thought  of  as  “multi-track"  beads  which 
can  be  positioned  over  more  than  one  node  at  a  time.  They  start  at  the 
left  edge  of  the  input,  read  nodes  one  at  a  time  from  left  to  right,  and  pass 
information  about  these  nodes  on  to  the  state  transition  functions  of  the 
parser's  recognizers. 

For  example,  consider  the  following  graph: 


A  parser  reading  this  grajili  would  start  off  with  its  read  head  positioned  to 
the  left  of  the  graph's  two  minimal  nodes,  like  this: 


>  ?>  2^ 
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It  would  then  select  one  of  the  two  ininininl  nodes  to  be  read  next  -  wc  don't 
care  wliich.  Let  us  say  it  choos<‘s  the  upper  one;  this  would  leave  its  read 
head  in  the  following  position: 


Here  the  parser  must  again  choose  which  node  to  read;  let  us  say  it  again 
chooses  tljc  upper  one.  '^hc  read  head  would  move  over  this  node  to  give 
the  following  position: 
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At  tliis  tli(T('  is  only  one  iiodo  tlu-  lower  onr  avail, ililc  for  reading. 

Intuitively,  rlie  r<‘a<l  head  is  not  “just  to  the  h'ft“  of  the  gr.iph  s  in.ixiinal 
node:  tluTe  is  still  a  pr('(eding  node  whi<'h  must  he  read  Krst.  Tlius.  the 
next  read  1hm<1  position  is  .’is  follows: 


Finally,  after  the  last  node  is  read,  we  have: 


and  the  read  head  stops. 

Wo  have  indicated  the  position  of  the  read  head  at  each  stage  by  denoting 
the  unique  set  of  edges  (possibly  leading  or  trailing  edges)  all  of  which  follow 
iJl  the  nodes  already  read  and  precede  all  the  nodes  yet  to  be  read.  We  call 
these  e<lge  sets  head  poailionf,  and  we  precisely  cljaracterize  the  order  in 
which  graph  parsers  examine  the  nodes  of  their  input  as  follows: 

1.  Each  parser  is  considered  to  have  a  read  head.  T)»e  initial  head  position 
of  the  read  head  in  the  input  consists  of  all  the  input’s  leading  edges. 

2.  The  parser  can  examine  any  node  all  of  whose  incoming  edge.s  arc  in  the 
current  head  position.  (Such  u  node  is  said  to  be  in  the  right  fringe  of 
the  head  position.) 
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3.  Wlirii  u  jiarscr  wiioso  nwl  Im-.u!  is  in  jmsifion  p  t'xaiiiitn's  a  node  n.  its 
rc'iiil  In  ad  moves  tt'  a  ni'w  positiini ;/  (alnilated  by  taking  ]i  anil  ri'iilaring 
n's  incoming  islj'es  by  its  ontj'oiiiK  ones.  (We  rail  ;/  tbe  ri-.iuire.t.tdr  of 
p.  The  node  n,  all  of  whose  oiitj'oin;'  I’llges  are  now  in  is  said  to  be  in 
the  left  fringe  of  p'.) 

4-  The  parser  exaniines  nodes  one  at  a  tiini*  until  it  reaches  a  head  position 
with  no  nodes  in  its  right  fringe. 

The  reader  can  verify  that  the  example  given  above  meets  the  above  con¬ 
ditions.  Some  thonght  will  also  show  that  (i)  a  node  is  never  read  until  all 
its  predeces.'ors  have  been  read,  and  (ii)  this  method,  when  applied  to  any 
How  graph,  eventually  read;  dl  the  nodes  in  that  graph. 

It  is  worth  noting  that  this  method,  while  phrased  so  as  to  apply  to  all 
flow  graphs,  describes  exactly  the  motion  of  our  string  parser  s  read  head 
through  its  input  “string  graph."  The  string  case  simply  makes  no  use  of 
the  non-determinism  inherent  in  step  (2). 

Each  time  a  graph  parser  examines  a  node,  it  pas.ses  three  pieces  of  in¬ 
formation  to  the  state  transition  functions  of  its  active  recognizers:  the  type 
of  the  node  read,  its  left-linkage  information  (a  set  of  port-edge  pairs),  and 
its  right-linkage  information  (another  set).  As  with  our  read-head  motion 
rules,  it  is  worth  noting  that  this  list  describes  in  a  general  manner  the  exact 
information  read  by  the  head  of  a  string  parser.  In  the  string  case,  however, 
the  left-linkage  and  right-hnkage  information  are  both  trivial:  it  is  always 
the  case  that  the  only  edge  in  the  old  head  position  went  into  the  node’s 
only  input  port,  and  the  only  edge  in  the  new  head  position  came  out  of  the 
node's  only  output  port. 

4.1.2.  Flow  Graph  Recognizers 

The  right-hand  sides  of  flow-grammar  rules  are  flow  graphs:  thus,  the  recog¬ 
nizers  from  which  wc  build  our  parser  will  be  flow  graph  recognizers.  These 
recognizers  will  receive  type  and  linkage  information  about  tlie  input  from 
the  parser,  and  compej’e  this  information  with  that  found  in  their  target 
graph  —the  right-hand  .side  they  are  recognizing.  Their  structure  and  func¬ 
tion  will  be  generalizations  of  those  of  their  string  counterparts:  that  is.  tliey 
will  he  state  machines  which  make  transitions  based  on  the  input  read. 


4.1.3.  States 

A  state  in  a  flow-graph  recognizer  consists  of  pairs  matching  edges  in  the 
recognizer's  target  graph  with  edges  in  the  parser's  current  head  position. 
For  example,  consider  the  grammar  of  tigiire  4.1.  and  the  graph  generated 
by  that  grammar  shown  in  figure  4.2.  At  some  point  in  the  parse  of  this 
graph,  tlie  recognizer  for  the  right-hand  side  of  the  A- rule  might  re.ach  the 
following  state; 
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Wc  havo  indicatt'd  the  parser's  liead  position  as  in  the  last  sertion;  the  labels 
on  the  input-graph  and  target -graph  edges  indicate  the  pairing  which  is  the 
state.  The  target-grapli  edge  paired  with  a  given  iiiitut  edge  is  called  the 
target  image  of  that  edge;  the  latter  is  the  input  image  of  the  former. 

It  is  convenient  (albeit  redundant)  to  think  of  a  stati'  as  having  two 
parts;  (i)  a  sot  of  edges  from  tljc  target  graph,  and  (ii)  a  1-1  correspondence 
between  that  set  and  some  of  the  edges  in  tlie  parser  s  head  position.  In 
tlii.s  view,  it  becoines  clearer  that  the  states  of  our  string  recognizers  had 
the  same  composition;  their  edge  set  was  the  edge  denoted  'py  their  Earley 
dot,  and  tlieir  correspondence  was  always  the  trivial  one  sending  that  edge 
into  the  single  edge  in  the  parsor'.s  current  head  position.  The  triviality  of 
this  correspondence  allowed  us  to  ignore  it  and  “pretend"  that  the  states 
of  our  string  recognizers  were  completely  determined  by  their  dot  position. 
We  do  not  have  tliis  hixury  in  tlie  graph  ca.se;  for  example,  examine  the  two 
states  shown  in  figure  4.3.  and  consider  which  of  these  states  should  begin 
a  transition  sequence  leading  to  an  accepting  state. 

4.1.4.  State  Transition  Functions 

The  state  transition  functions  of  our  graph  recognizers  take  as  inputs  a 
reeognizer  state  and  the  type  and  linkage  information  of  an  input  node; 
they  produce  a  new  recognizer  state  .as  output.  Recognizers  operate  in  the 
expected  manner;  they  apply  their  state  tr.an.sition  functions  to  their  current 
state  and  the  information  returned  by  the  parser's  read  head,  .and  then  make 
a  transition  to  the  new  state  returned  by  the  tr.ansition  function  (if  any). 

Tlie  state  transition  function  of  a  graph  recognizer  is  best  thought  of  as  an 
algorithm  that  proceeds  in  two  steps;  it  first  determines  wli<’tli('r  a  transition 
exists  from  the  given  state  on  the  given  input;  if  so.  it  flnm  determines 
the  state  that  the  transition  leads  to.  In  otln-r  words,  the  algorithm  first 
deteriiiiiips  the  acceptability  of  the  input,  and  then  it  determines  the  correct 
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Figure  4.4.  Some  acceptable  (state,  input)  pairs, 
next  state  for  its  recognizer. 

Acceptability  is  determined  by  comparing  the  type  and  left-linkage  in¬ 
formation  of  the  input  node  read  with  that  of  the  target  graph  node  which 
corresponds  to  it.  More  precisely,  let  s  be  the  the  current  state,  let  ri  be  the 
input  node  read,  let  L  be  the  set  of  input  edges  of  n.  and  let  L'  be  the  set 
of  target  images  of  L  under  s.  If  L'  consists  of  all  the  input  edges  of  some 
target  graph  node  n' ,  if  the  type  of  n'  is  the  same  a.-;  the  type  of  n.  and  if 
the  port  adjoined  on  n'  by  each  edge  in  V  is  the  same  as  the  port  adjoined 
by  its  input  image  (in  L).  then  ri  is  said  to  be  acccjitahle  and  n'  is  said  to  be 
its  target  image.  Figure  4.4  shows  examples  of  acceptable  input  situations; 
figure  4.5  siiows  some  unacceptable  ones. 

Once  the  acceptability  of  an  input  no<le  has  bc'on  determined,  the  new 
state  to  move  to  is  computed  by  matching  its  riglit-linkage  information 
against  that  of  its  target  image.  More  precisely,  let  s.  n,  n' .  L.  and  L' 
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Figiorc  4.5.  Some  unacceptable  (state,  input)  pairs. 


be  as  above,  let  R  be  the  output  edges  of  n.  and  let  R'  be  the  output  edges 
of  n'.  The  new  state  s'  is  computed  by  (i)  deleting  from  s  all  pairs  involving 
edges  in  E,  and  (ii)  adding  a  new  peiir  for  each  edge  in  R.  In  step  (ii).  the 
pair  added  for  an  edge  e  which  leaves  n  from  a  port  p  pairs  it  with  tlie  target 
graph  edge  e'  in  R'  which  leaves  n'  from  p  (Since  n  and  n'  have  the  same 
type  and  tlins  the  same  port  sets,  this  operation  is  well-(lefined.)  Figure  4.6 
shows  the  (new-state,  new-inpnt)  jiairs  computed  from  the  p.airs  of  figure  4.4 
by  tills  procedure.  Notice  that  state  pairs  not  involving  input  edges  to  the 
input  node  road  are  unaffected. 

As  the  reader  may  have  noticed,  this  proredure  agrees  with  that  u.sed  to 
determine  the  state  transition  functions  of  our  string  recognizer,  hi  fact,  if 
we  take  into  account  both  the  edge  majiping  implicit  in  our  string  recognizer 
states,  and  the  linkage  information  implicitly  road  by  the  string  parser  read 
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Figure  4.7.  A  graniniar  and  a  .otHte  in  wliifli  a  suU-rftognir.er  should  be  invoked. 


Figure  4.8.  The  initial  state  of  the  sub-rccogniicr  invoked  from  the  state  of  fig¬ 
ure  4.7. 


head,  this  is  the  procedure  used  to  compute  the  state  transition  functions 
in  our  string  parser. 

4.1.5.  Linkage  Mechanism 

Whenever  a  recognizer  moves  into  a  state  v  hose  edge  set  contains  inputs  to  a 
non-terminal,  the  parser  will  invoke  a  sub- recognizer  for  that  non-terminal. 
For  example,  consider  the  gramnmr  .and  state  sliown  in  figure  4.7.  Two  of 
the  target-graph  edge.s  in  the  state  of  the  5-rerognizcr  are  inputs  to  the 
non-terminal  D.  so  the  parser  calls  a  recognizer  for  B.  giving  it  the  initial 
state  shown  in  figure  4.8. 

The  initial  state  of  the  B  recognizer  has  followed  by  “transitivity"  from 
the  port-correspoiidciicc  information  in  the  grammar  nih'  for  B  Li  general, 
suppose  recognizer  state  s  contains  t.argct  edges  e^— f/u'get  images  of  edges 
C;— which  are  inputs  to  a  non-termiii.al  node  n'.  The  parser  deletes  any  edge 
p.airs  from  s  which  iiivolve  tlic  c'  chooses  a  production  P  whi<  h  diTivcs  the 


Fifiiire  4.9.  An  iicccpting  state  for  llio  rorogiiitrr  invoked  jji  figure  4.8.  Tliis  rule 
should  be  reduced. 


Figure  4.10.  The  result  of  the  reduction  invoked  in  figure  4.9. 


type  of  n',  and  invokes  a  recognizer  for  the  right-hand  side  of  P.  Tlie  initial 
state  s'  of  this  recognizer  will  contain  one  pair  for  each  edge  Cj  as  follows: 
Suppose  enters  n'  at  port  py,  and  suppo.se  port  Py  is  mapped  by  P  to  port 
Pj  on  port  n  (in  P’s  right-hand  side).  Then  s'  will  pair  the  leading  (target) 
edge  entering  n  with  (the  input  image  of  e').  The  reader  is  encouraged 
to  verify  that  this  procedure  produces  the  state  of  figure  4.8. 

The  operation  dual  to  invocation  of  a  sub-recognizer  is  the  return  of  that 
sub-recognizor.  In  the  example  given  above,  the  state  of  the  P-rccognizer 
after  the  parser  reads  node  n  will  be  that  giVen  in  figure  4.9.  The  edge  set  of 
this  state  contains  a  trailing  edge,  so  the  par.«or  will  reduce  tlie  recognized 
rule  and  move  the  calling  -recognizer  into  llu-  state  shown  in  figure  4.10.  In 
general,  whenever  a  state  contains  a  target -graph  trailing  edge,  the  parser 
will  perform  a  reduction  by  adding  edge  j)airs  to  the  caller's  state  in  a 
procedure  which  revirsc.s  that  used  at  invocation  time. 

The  reader  must  by  now  be  exptvting  the  following  claim:  this  linkage 
mechanism  is  a  general  plira.^ing  of  the  exact  niechani.-iiii  used  by  tlie  string 
parser.  It  simply  make  exjilicit  the  manipulations  of  tlie  target-graph/iii{)iit- 
gr.apli  edge  corresj)ondenee  that  were  left  implicit  in  the  .-itriiig  case. 
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4.1.6.  Flow  Graph  Parsers 

Wf  hav<'  now  introdiircd  tlic  tlin-i'  haiiic  coinpoucnts  of  our  parr't'r  cou- 
ntruftioii  t(’(  huii]u<‘;  a  iiiocliaiiiMii  for  roadiiij;  tlir  injiut.  flu-  rccof^iii/a'r!*  for 
iiulividual  nd«‘s.  and  the  linkage*  nicclianisni  to  intmonni'i  t  rcfof'nizors 
fur  ddfcrcnt  ndcr;.  Ratlior  tlian  statu  .a  coinplutu  fonstruction  nicrlianisni 
(aw  w<'  did  in  tliu  previous  rliai)ter).  we  will  instead  ronsiiler  two  examples  of 
graminnr/Brapli  pairs  and  the  behavior  of  the  parser  ruiistrurted  for  them. 
These  examples  will  expose  some  details  of  the  construction  and  behavior 
of  the  resulting  parsers  that  have  not  been  considered  thus  far.  in  addition, 
they  will  introduce  a  representation  that  forms  the  basis  for  that  used  by 
our  simulation  algorithm. 

A  Simple  Example 

Let  us  start  by  considering  the  beiiavior  of  a  parser  constnicted  for  the 
following  simple  grammar: 

-s- 

—A— 

-5-  => 


when  run  on  the  following  graph: 
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Tliij«  iinrspr  stiirts  off  by  ralliiij'  tin*  rwogjiiziT  for  tli(>  aide  of 

tlu'  nilc  deriving  Tlir  jiarsor  stack  is  empty,  and  its  rca<l  lH-a<l  is  over 
th<*  leading  edg('  of  tin*  iiijnit.  Siu<'<'  tlu-re  is  only  oin*  s\i(  li  edge,  tin-  parser 
has  no  choice  in  determining  the  .S’-rerognizer's  initial  .stat<';  that  is,  there 
is  only  one  possible  rorrespornlenre  betwe<‘n  the  leading  ('dges  of  the  input 
and  those  of  the  A'-r<‘0ogui7-er*s  target  graph.  (We  consider  below  how  to 
make  this  choice  in  general.) 

The  initial  configuration  of  the  parser  is  as  follows: 


At  this  point,  only  one  node  in  the  input  is  readable.  As  the  parser's  read 
head  reads  and  moves  over  it.  its  type  and  linkage  information  ia  used  to 
make  a  state  transition  in  the  5-rccognizcr.  Of  course,  if  the  state-transition 
algorithm  determined  the  inptst  to  be  unacceptable,  the  parser  would  stop 
and  reject  the  input.  In  this  case,  however,  the  parser  moves  into  the  fol¬ 
lowing  configuration; 


This  state  contains  target  edges  which  arc  inputs  to  the  non-terminals  A 
aud  B.  The  parser  thus  invokes  sub-recognizers  for  these  nodes,  moving 
into  tlic  following  coiifigu.’ation; 


■'•■3 
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The  following  points  are  worth  noting: 


•  We  arc  no  longer  using  a  bimple  stack  to  keep  trcick  of  .«nb*recognizer  calls. 
Because  nmltiple  call?  may  be  made  from  a  single  state,  we  use  a  “tree- 
shaped  stack”  that  koi-ps  track,  for  each  call  made,  of  both  the  calling 
state  and  the  particular  node  being  recognized  in  tlie  caller's  target  graph. 


•  This  behavior  appears  different  from  that  of  the  string  recognizer,  which 
left  an  “Earley  dot”  in  front  of  the  node  being  derived.  In  fact,  this  dot 
6orve<l  to  identify  the  node  being  derived — a  function  now  handled  by 
information  kept  on  the  stack- -not  as  a  state  marker. 


The  parser  is  now  ready  to  read  another  node.  Let  us  say  it  roads  a;  this 
leaves  it  in  the  following  configuration: 
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The  recognizer  for  A  lias  now  moved  into  an  accepting  state,  so  the  parser 
reduces  the  production  involved  by  moving  into  this  configuration: 


Note  that  the  5-recognizer  has  changed  state  while  its  call  to  the  ZJ-recognizer 
is  out.Htauding.  This  could  never  happen  in  the  string  parser.  To  emphasize 
tins  mutability  of  the  state  information  stored  in  a  graph  parser's  stack,  we 
think  of  the  stored  information  as  state  objects  rather  than  states. 


c,'. 
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Next,  the  5-nodc  is  read,  and  the  iJ-recognizer  changes  state  accordingly: 
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The  i?-roro^iiizer  has  now  moved  into  an  accepting  state,  so  the  parser 
reduces  its  ni’e  and  moves  into  the  following  configuration: 


Notice  that  the  5-recognizer  state-pairs  derived  from  the  reduction  proce¬ 
dure  are  added  to  those  of  its  prior  state.  This  additivity,  together  with  the 
tree-shaped  stack,  allows  multiple  simultaneous  calls  to  sub-recognizers. 

Finally,  the  parser  read  the  m-node  and  moves  into  the  following  config¬ 
uration; 


The  parser’s  input  has  been  completely  read,  and  its  trailing  edges  are  in 
correspondence  with  idl  the  trailing  edges  of  the  5-recognizcr's  target  graph. 
The  parser  accepts. 
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A  Complex  Example 

TIk'  foIK)Wiii(i  c'xami)I<'  (h'nion.'traft's  tlu>  b<-liavi(ir  of  a  jwirscr  wliosc  graiii- 
iniir  aii<l  r<'a<l-li<'.i(l  motion  (•oiiil)iii(’  to  pnxlucc  "stag^'Tod  invo<atious  atnl 
mluctioms."  (\>iisi(l»'r  the  following  graniiiiar: 


which  <i«'riv<*8  the  following  graph: 


n 


Unlike  the  grammar  consider’d  in  the  last  example,  the  start  symbol  for 
this  grammar  has  two  inputs,  so  the  parser  constricted  from  it  must  make 
some  determination  as  to  which  of  the  input  graph's  inputs  correspond  to 
which  of  the  start  syinbol's  inputs.  In  general,  there  is  no  way  (short  of 
trying  each  possibility)  that  a  parser  e.ui  determine  which  choice  of  corre¬ 
spondences.  if  any.  allows  a  parse.  Thus,  in  our  desrription  of  this  parser 
(and  in  oiir  simulation  algorithm),  we  will  assume  that  the  input  itself  con¬ 
tains  a  specification  of  one  such  correspondence,  and  the  constructed  parser 
will  use  that  one.* 


'Since  the  sinmlation  algoritliin  lakes  both  graininar  and  Brnpb  as  input,  the  teriiu  for 
such  n  specification  are  readily  at  band. 
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Let  Its  assuiiH’,  then,  tliat  tlie  jHirser  hir  tlir  ahovt-  graniniar  starts  in  tlir 
following  <  i)nfi('"r^‘*j'»‘  <*»  above  grajili: 


The  A’-nToKiiizor's  state  contains  an  iiipat  edge  of  the  non-tenninal  A,  so 
t!ic  parser  activ.atcs  a  recognizer  for  A  and  moves  into  the  following  config¬ 
uration: 


The  following  points  are  worth  noting: 

•  The  parser  has  started  the  <4-recognizer  before  it  can  determine  an  input- 
edge  correspondence  for  all  of  A's  inputs.  When  node  nj  is  read,  and  the 
parser  determines  a  correspondence  for  A's  other  inpiit.  the  now  input 
will  be  added  to  the  recognizer's  (then-current)  state.  This  process  is 
called  staggered  invocation. 

•  Only  those  pairs  involving  input  edges  of  A  have  been  deleted  from  S's 
state.  This  “subtraetivity"  is  dual  to  the  additivity  of  the  reduction 
process. 

•  Configurations  which  involve  partial  states,  such  as  this  one,  will  always 
result  from  situations  in  which  the  head  image  of  a  recognizer’s  state  con¬ 
tains  some  but  not  all  of  a  non-tcruiinal's  input  edges.  In  these  situations, 
the  parser  will  invoke  a  sub- recognizer  for  the  non-termiutvl  involved  even 
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if  the  input  nirrcspondiii}'  to  fho  ii<»ii-t<*niiinal  s  iiijiiits  arc  not  in¬ 

puts  to  a  node  in  the  ri};ht  fringe  of  tin'  parser  s  rea<l  head  position.  For 
example,  ill  this  configuration; 


i 
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a  parser  would  invoke  a  recognizer  for  D  even  tliough  tlic  node  b  is  not 
yet  eligible  for  reading. 

The  parser  is  now  ready  to  read  a  node;  let  us  say  it  reads  the  I  node.  It 
would  move  into  the  following  configuration: 


in  which  only  the  n  node  is  readable,  giving: 


'■..-■-.I 
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TIk'  otlii'r  input  to  tlu'  jjrcviously-iiivokcil  /l-riTO(;iii/.(T  li;i^  I'lrrivcd.  so  flu* 
p.irstT  ailds  it  to  that  rccogui/cr's  state: 


A  car'-ful  reader  niay  have  noticed  that  we  have  drawn  a  two-way  arrow  be¬ 
tween  the  A-recognizor  and  the  node  it  was  called  for.  This  is  to  remind  us 
that  the  parser,  in  order  to  do  this  staggered  invocation,  must  keep  track  not 
only  of  which  node  a  recognizer  was  c.alled  for,  but  also  any  recognizer  that 
has  already  been  Ccdled  for  a  given  node.  That  is.  in  addition  to  keeping  “re¬ 
turn  pointers”  with  active  recognizers,  the  parser  must  keep  “call  pointers" 
with  non-terminal  nodes  that  have  sub-recognizers  active  for  them. 

The  parser  now  road  the  m  node,  leading  to  the  following  configuration: 


prt' 

m  T 


This  situation  is  the  converse  of  one  encountered  earlier:  instead  of  one 
(but  not  all)  of  the  A-recognizer's  inputs  having  bcs>n  rcaclu  d.  one  (but  not 
atl)  of  its  outputs  have.  The  par.^er  pcrforni.s  a  stayijercd  reduction  similar 
to  the  staggered  invocation  it  performed  earlier,  and  reaches  the  following 
configuration: 
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Tlie  parser  is  now  ready  to  read  either  the  n-  or  tiie  /-node.  Let  us  say  it 
chooses  n,  this  leads  to  the  following  configuration: 


Finally,  the  parser  reads  the  i-node  and  moves  into  this  configuration: 


This  configuration  allows  the  completion  of  the  staggered  reduction  started 
earlier,  so  the  parser  terminates  the  A  recognizer  and  adds  to  the  state  of 
the  5-recognizer: 
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This  is  an  accepting  configuration. 

4.2.  The  Parsing  Algorithm 

We  are  now  ready  to  present  our  flow  graph  parsing  .ilgorithm.  The  aigo- 
rithra  simulates  the  behavior  of  a  non-decenninistic  graph  parser,  exploring 
simultaneously  cdl  the  parser's  reachable  configurations.  As  with  the  string 
algorithm  of  the  last  chapter,  it  will  be  useful  to  think  of  the  algorithm  as 
simultaneously  simulating  a  large  number  of  graph  parsers,  each  of  which 
eventually  makes  diflforent  guesses  as  to  the  derivation  tree  of  the  input. 

4.2.1.  Preliminaries 

We  introduce  here  an  item-based  notation  for  the  configurations  of  a  graph 
parser.  We  will  simulate  a  given  graph  parser  by  constructing  item  lists, 
similar  to  tho.se  of  the  last  chapter,  which  show  the  parser’s  configuration 
at  each  step  of  the  input. 

The  basic  unit  of  the  notation  is  a  representation  of  a  state  object  called 
a  state  item  (or  just  ifem).  Items  are  composed  of  three  parts;  a  state  of  a 
graph  recognizer,  a  list  of  pending  calls  to  other  items,  and  a  hst  of  items 
to  return  to.  In  addition,  itcm.«  will  sometimes  be  annotated  as  dead,  and 
they  will  sometimes  be  marked  with  an  Ji-Jlag.  (We  say  more  about  these 
annotations  below.)  As  before,  we  represent  the  pointers  in  call  lists  £ind 
return  sets  with  integers,  and  we  subscript  items  with  integers,  yielding  a 
representation  like  this: 

((state),  (call  list),  (return  pointer))jjj 

Using  this  r»’presentation.  we  can  represent  the  configuration  of  a  graph 
parser  by  showing  its  read  head  po.-.ition  in  the  input  and  items  for  the 
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stikt<'  of  .ill  its  n'cof^iii/crs.  Tin-  corn-spoinli’Ticc  part  of  ra<h  stato 

rt  prcsniuilioii  will  l)o  imlii  alcd  Ity  lalK-liiiK  llio  tars^’t  mill  iiijint  i'iIki's  in- 
volvoil.  Fur  ux.iiiiiilu.  in  tlir  first  sanii>lu  nui  shown  .ihovi'.  tlic  coiiHf^nr.ition 
oht.iiiu'il  just  afliT  tiir  invoc-.iliuu  of  tlio  A-  ami  JO-rci'oj'iii/crs  can  he  given 
.-us  follows: 


,  (Oh  s')) , 

[a^ 

(The  subscripts  used  here  are,  of  course,  arbitrary.) 

We  say  that  the  ptirser's  active  recognizers  (or  active  items)  are  those 
whose  states  are  non-empty.  In  the  example  above,  only  the  A  and  B 
recognizors  are  active:  the  S  recognizer  is  said  to  be  suspended. 

When  we  wish  to  show  the  entire  run  of  a  graph  parser  on  a  given  input, 
we  can  compress  the  space  used  by  showing,  after  each  read  operation,  only 
those  items  are  active  or  which  made  a  state  transition.  For  example,  the 
run  of  a  graph  parser  on  the  gr.ammar  and  input  graph  shown  above  is  shown 
in  figure  4.11. 

While  this  depiction  of  a  parse  run  looks  a  lot  like  tlie  p.arse  lists  of 
E.arley’s  .algorithm,  there  cire  .‘•ornc  important  differences.  First,  not  all  active 
items  in  a  given  list  change  state  when  the  next  node  is  re.id.  Second,  more 
th.an  one  active'  item  in  a  given  list  c.on  repri'senr  recognizer.^  invoked  by  a 
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single  jxirsor.  In  EnrlcyV  algorifliin.  oncli  mtivc  item  r(‘i)rrseiite(l  the  only 
recognizer  currently  <u  tiv<'  for  at  leiist  one  parser. 

4.2.2.  Optimizations 

As  we  did  witli  Earley's  algorithm,  we  will  coalesce  the  ittuiis  representing 
recognizers  for  the  same  rule  which  were  stiu’tcd  at  the  same  input  position 
and  axe  in  the  same  state:  one  item  will  be  used  to  represent  the  state  object 
of  all  such  recognizers.  In  order  to  accomplish  tliis.  we  will  be  using  the 
two  optimization? — multiple-call  collapsing  and  duplicate-item  merging — 
that  were  introduced  in  the  last  chapter. 

Because  the  linkage  mechanisms  of  graph  parser.?  are  more  complex  than 
tho.ie  of  .string  parsers,  wc  must  b<-  more  carehil  in  applying  optimizations. 
In  particular,  the  presence  of  staggered  invocations  and  reductions,  and  the 
fact  that  calling  items  can  change  state  while  their  callees  arc  still  active, 
lead  to  cases  that  require  a  very  good  understanding  of  the  intent  of  the 
optimizations.  Thus,  rather  than  proceed  directly  with  the  statement  of  our 
parsing  algorithm,  we  will  first  consider  some  examples  of  its  behavior. 

4.2.3.  Examples 

In  this  section  we  run  the  parsing  algorithm  on  five  different  grammar/graph 
pairs.  Each  sample  run  exposes  a  different  facet  of  tlie  algorithm’s  behavior; 
between  them  these  examples  cover  all  the  cases  that  the  algorithm  handles 
specially.  Having  once  understood  all  five  of  these  examples,  readers  should 
have  little  difficulty  understanding  the  complete  statement  of  the  algorithm 
which  follows  them. 

For  each  example,  we  show  all  of  the  item  lists  constructed  by  the  al¬ 
gorithm.  Each  such  list  is  followed  by  a  some  explanation  of  how  it  was 
constructed. 
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Example  1. 

Till."!  {'xaiijj)lc  (  (Hisidcrs  tlif  <if  stAt4*  in  Hie  calliT  wliili'  a  <  allr*> 

i:i  still  active’.  It  iiitroeinccs  tlic  r.-Mjilit  (ijuTatioii.  an  <)))e’ratinii  invoked  at 
conijdction  time  wliicli  si>lits  a  .>iin};l<'  calliii};  item  into  two. 

Tlic  pn’vion.x  pa^c  shows  a  I’raminar.  tin*  input  graph  dcrive’d  hy  that 
grammar,  and  the  ite-m  list  constructed  by  the  siniultition  before  any  nodes 
have  been  read.  No  iion-torniinals  have  bc'en  predicted  at  this  point,  .so  only 
one  item  is  necessary. 


G4 


4  Tln'  Ahoritlim 


r,;- 


4.2  Tilt'  Piirxiiif' 


G5 


H»T('  is  tlu'  list  iift(T  rt'atliliK  node  Mj.  1  was  nrtivi;  on  the.  riiidt:  rend', 
tliat  is.  its  statf  cinitaiin'd  iiijaits  of  that  iiodo.  Tlu'  node  was  acccjytahlc  (as 
jKT  .scclioii  -1.1.4).  anil  tin-  rcsidtin;'  transition  has  lod  to  a  slate  eontaiiiin}; 
iii|mts  to  till'  iion-terniitials  D  and  A.  (The  ‘( ]'  syinhuls  .irDiind  llie  ed^es  f;i 
and  12  in  item  1  indirate  that  those  edges  were  i)r<‘sent  in  that  item's  state 
inimediately  after  the  injait  node  w.is  sraiiiied.  hnt  were  then  deleted  as  a 
result  of  the  sub-nvoRiiizi'r  call  mechanism.) 

Only  one  derivation  decision  is  possible  for  the  ^-nodc.  but  two  arc 
po.ssible  for  the  D-nodc.  hitnitivcly.  item  1  represents  the  S’-reeognizer  for 
two  parser.s.  Each  has  made  a  different  derivation  division  for  D.  but  both 
remain  in  the  same  .state  and  were  started  at  the  same  input  position.  Thus, 
we  represent  both  with  a  single  item  and  u.se  the  call  list  for  D  in  that  item 
to  keep  track  of  both  outstanding  calls. 
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Now  we  n';wl  node  nj.  Item  4  was  th<'  only  one  aetive  on  tliis  node,  so 
it  makes  an  ai)])ropriate  transition.  Us  ik-w  slal<'  ne<essitates  jtredicting 
tli('  two  ZJ-iiodes  by  invoking  apiirojiriate  snl)-r<'cogni/-<‘rs:  tliis  lia[)j)ens  in  a 
j)roc<'ss  ex.'U'tly  like  that  .sei-n  in  the  last  list  Items  0.  C.  7.  and  8  are  th<' 
result;  notice  that  although  th«-  n'eogni/.ers  for  the  upper  ami  lower  H-nodes 
are  being  st carted  on  the  same  list,  they  car<'  not  started  at  the  same  input 
position  for  the  purposes  of  multiple-call  collapsing. 

Items  2  and  3  are  on  this  list  because,  while  they  were  not  active  on 
the  node  read,  they  are  active  on  a  node  eligible  to  be  read  This  copying- 
forward  of  active  items  insures  that,  each  time  a  node  is  read,  all  the  items 
active  on  that  node  will  be  present  on  the  previous  list.  Thus,  we  never  have 
to  search  back  through  prior  lists  for  active  items. 
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Now  tile  fui)  Ix'^iiis.  W('  read  iimlf  /»2  and  it<Mii  5  iiiovch  into  an  a(  (  (‘j)tin}' 
state.  We  can  now  coniplctc  nod<'  Di  of  item  4  hy  li'tlin;;  item  5  return. 
Dnt  recall  that  it(‘m  4  represents  two  r<‘c<i^pii/,cT.s;  one  which  predict('d  Z?i 
via  item  5  and  oih'  which  j)redicli'd  Z?i  via  item  G.  If  we  iiiak<'  the  state' 
transition  in  it<'m  4  ralh'd  for  hy  the  return  of  item  5.  we-  will  have  made  a 
spurious  state  transition  in  tin'  recetRuizer  which  calU'il  item  G. 

The  solution  is  to  c-nplit  item  4  into  item  9.  This  process  separatos  into 
two  itenis  the  rejiresontation  of  the  two  rwognizers  where  were  merged  in 
item  4.  It  works  by: 

1.  Copying  item  4  to  the  new  iti-in  9.  (This  gives  ns  two  itetns  each  of  which 
rejirescnt  both  of  the  recognizers  merged  in  item  4.) 

2.  Removing  the  call  to  item  5  from  item  9.  removing  the  call  to  item  6 
from  item  4.  and  removing  the  return  to  item  4  hy  item  C.  (This  makes 
each  of  item  4  and  item  9  represent  only  one  of  the  two  recognizers  that 
were  merged  in  item  4.) 

3.  Going  through  all  the  cajlecs  of  item  9  and  informing  them  about  their 
now  caller.  (This  keeps  the  call  list  of  item  9  and  the  return  sets  of  its 
callees  consistent.) 

4.  Going  through  all  the  callers  of  item  9  and  informing  them  of  their  new 
callee.  (This  keeps  the  return  set  of  item  9  and  the  call  lists  of  its  callers 
consistent.) 

The  effects  of  the  c-split  operation  can  be  seen  in  items  1.  4,  6,  7,  8,  and  9 
of  the  current  list;  once  the  c-split  is  complete,  item  5  returns  to  item  4  as 
described  in  section  4.1.5. 

Note  that  items  2  and  3.  which  have  been  brought  forward  to  this  list 
because  they  are  active,  are  unaffected  by  the  c-split.  In  general,  none  of 
the  ‘siblings'  of  a  c-split  item  are  affected  by  that  split;  only  its  ‘parents’ 
(callers)  and  cbaldren'  (callees)  are  affected. 
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Hi'.-idiiij'  ini<I<'  h^  putr<  item  7  in  an  accrptin^  state.  Tliis  (■-sj)li;s  item  4 
into  item  10  and  it('ni  9  info  ifeni  11  for  the  sanio  re/istnis  as  item  5  r- 
split  it('!ii  4  in  the  last  list,  only  tliis  time  it  is  fli<'  D2  mule  that  lias  other 
derivations  jirnding. 
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We  r<  ;i(]  /)3,  ai;:l  flic  sliakcoiil  of  s|>iirinti<  parses  lie^iiis.  Items  -1  and  10 
are  active  on  tlie  n(i(l<'  read  lint  it  is  not  ai-ceptalde.  so  tlieir  n-coj^ni/.ers  re¬ 
ject.  We  indicate  tliis  liy  marking  tln-se  items  as  druil.  a  steji  wliicli  was  nut 
necessiiry  in  tli<-  striiij^  case.  Tlie  jioint  liere  i.s  that.  alllionj;li  tlie  recogniz¬ 
ers  represi'iited  liy  llies('  items  have  rejected.  tln'V  may  liave  jiending  call.s 
t<i  otlier  recognizers.  If  these  oiher  rocogiiizc'rs  were  allowed  to  return  to 
tlioir  dead  callers,  these  returns  might  canse  staii  transitions  which  lead  to 
sptirions  parses.  By  marking  the  iiinns  for  rejei  ting  recognizers  with  dead. 
we  will  know  to  snitprcss  future  returns  to  tlio.so  items. 

Reading  .also  puts  item  G  into  an  accepting  state,  but  its  return  to 
items  9  and  11  dues  not  cau.se  them  to  c-split  becau.'.e  they  liave  no  other 
recognizers  jicnding  for  the  Bi  node  tliat  item  G  completed. 

Items  1.  3.  and  8  are  coiiicd  tmch.inged  from  the  previous  list  because 
they  are  active.  Note  that  item  8.  although  it  contains  item  10  in  its  .etern 
list,  is  michangcd  by  the  fact  that  item  10  has  died.  If  item  8  were  e.  -c  i. 
move  into  an  accepting  state,  its  return  to  item  10  would  amply  be  ignored. 
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W<‘  read  node  Cj.  Itciii.-f  8  and  11  dii-.  Ifciii  9  move.'  inti)  an  a('C('j)tin(^ 
fitaU'.  cansinj;  ili  ins  1  ainl  12  to  f-.-iiilit  into  items  13  and  H.  This  split 
taki-s  place  even  tlniu*;!!  noin-  of  the  pending;  calls  for  the  .d-nnde  conipletial 
hy  item  9  are  to  liv<‘  items;  tlu'  decision  whelhi'r  or  m.t  to  c-splif  is  made 
solely  on  the  basis  of  m;mh»'r  i>f  i>en<lin^  caalls.  On  th<'  other  hand,  boi'ansc 
items  4.  10.  ;uid  11  are  ilea<l.  the  npdatini'  of  their  r<'t\irn  s('ts  normally  done 
by  till'  r-splits  of  items  1  and  12  .are  suppressed. 


J  T}j<‘  AlfCorillmi 


4.2  TIiv  Altiariflim  y, 

V\i'  nad  node  ct.  Itnn  1.  wliich  i:<  a  top-jt-vrl  item,  moves  into  an  ar 
cepdii}'  state  that  iiielmles  all  ofits  frailiii-  edi-es:  the  input  is  a(e('i)le(l. 


e. 

j~ 


[3=^ 

[3  4-a-C^ 


Ex.iiiiplf  2,  lj»l  0. 


4  The  Alf'ontlitii 


None  ) 


4.2  Tltr  riiTsiiif'  AJf'ori thill 
Example  2 
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Tliis  ('Xiiiiiph'  ('Xplort's  tli<'  interaction  of  nniltipli-r.vll  collapsin'^  and  sfan- 
{'(TC'cl  invocation  It  introdiici's  tiic  p-njiltf  operation,  in  wliich  ;in  item  is 
sj)lif  into  two  it<'iri.s  as  tlio  r<‘snlf  of  a  pre<liction  ojx'ration. 

We  start  off  with  jnst  two  it<‘ins,  one  for  earli  derivation  of  .S'. 


87 


9 

“^V 

•% 

S\' 

s. 


^V- 

t'v 

iiV 

M 

p-  - 


K 

Lv 


■/.2  TIiv  Piirsiiifr  Alfforithiu 

Wlicii  we  r<‘a<l  iiixh'  the  .S'-rrcdj'iiizc'r  nf  item  1  imivcs  inid  a  state 
containing  the  other  input  of  A.  Tliis  r(‘ci»giiiz('r  niiist  ])ass  fliis  new  injuit 
down  to  the  .4-ree(ignizers  of  items  3  ami  -4.  hut  these  items  also  repn'sent 
rcrogniziTS  invok<'(l  hy  item  2.  which  <loes  not  want  to  jnass  down  tliis  st-comi 
input. 

Tliis  situation  is  coiniileuK'iitary  to  that  in  which  wc  c-siilit  a  calliT, 
and  the  solution  is  also  complementary:  we  p-split  the  rallee.  By  this  wo 
mean  we  split  the  representations  of  the  two  recognizers  merged  in  item  3 
among  two  items,  and  we  do  the  same  with  item  4.  Each  of  these  p-splits  is 
arconiplished  similarly,  for  item  3  we  do  it  by: 

1.  Copying  item  3  to  item  5.  (This  gives  us  two  items,  each  representing  a 
recognizer  invoked  by  two  parsers.) 

2.  Removing  item  3's  return  to  item  2.  item  o's  return  tu  item  1,  and  item  2's 
call  of  item  3.  (This  makes  each  of  the  items  represent  a  recognizer 
invoked  by  just  one  of  the  two  parsers.) 

In  the  general  case,  items  3  and  4  might  have  had  outstanding  calls,  in 
wl’.ich  case  we  would  have  made  their  callees  return  to  both  them  and  their 
p-splits. 

The  result  of  the  p-split  is  that  we  can  now  pass  down  the  new  input 
from  item  1  to  items  3  and  4  without  hurting  the  recognizers  invoked  by 
item  2.  Thus,  we  arc  ready  to  read  the  next  node. 


••• 


V' 


•^V 


34 


Tannenljaum,  Robert  and  Warren  H,  Schmidt.  "How  to  Choose 
a  Leadership  Pattern."  Harvard  Bi^ines^R_evi ^ 

(Ma^VJune  1  973)  :  162-180. 

Vroom,  Victor.  "Can  Leaders  Learn  to  Lead?"  Organ- 
iaational  Dynamics  3-4  (’Winter  1976):  17-28. 


